IMAGE PROCESSING METHOD AND SYSTEM, AND STORAGE MEDIUM 



BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The present invention relates to an image processing method 

and system in which representation of the difference between two 
or more images taken of the same subject is improved. 

Description of the Related Art 
It is a common practice in a wide variety of fields to read 
10 and compare a plurality of two or more images taken of the same 
subject in order to discern the difference between images, and 
carry out an inspection of the subject based on the thus discerned 
difference, etc. 

In the industrial products manufacturing industry, for 
15 example, images taken of a product when it is new and images taken 
of the same product after it has been subjected to an endurance 
test are compared, and attention is focused on the area showing 
the biggest difference so that an examination as to whether or 
not there are areas requiring improvement in product endurance 
20 can be carried out . in the medical field, doctors read and compare 
a plurality of radiation images of the diseased part of a patient 
taken in a time series manner in order to ascertain the course 
of the disease and determine the proper treatment. 

In this fashion, reading and comparison of a plurality of 
25 images is carried out daily in a wide variety of fields, with 
the images to be read and compared being output to a display means 
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such as a monitor, to film, or another recording medium. In other 
words, the image is converted to luminescence and density signals 
and displayed on a monitor, etc., or output to film or another 
hard- copy recording medium by a printer or the like. 
5 Generally, although the area of the most interest to the 

viewer of such images is the area wherein the greatest difference 
is shown, when the images to be read and compared are output, 
they are simply lined up and output . However, under such conditions , 
the smaller the difference between the images is, the more 

10 difficult it becomes to discern. 

Therefore, image processing methods that facilitate 
discernment of the difference between images with a higher degree 
of accuracy and reliability are desired. These generally start 
with a subtraction process that calculates the difference between 

15 corresponding structural positions (anatomically characteristic 
positions) of the two images, followed by extraction and 
enhancement of the aforementioned difference (Japanese Patent 
Application No. 11 (1999) - 342900) . In this way, only the difference 
between images is extracted and enhanced, thereby enabling the 

20 viewer to ascertain the difference with certainty, and this is 
considered to contribute greatly to the prevention of misdiagnosis 
due to oversight of a diseased part requiring treatment or the 
course of progression of a disease. 

In addition, when computation of the interimage - difference 

25 is to be performed, it is necessary to first align the corresponding 
positions of structural bodies appearing in each image (structural 
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positions) . Such alignment might entail as a first alignment, 
for instance, a global transformation (affine transformation, 
etc.) of parallel displacement , rotating and enlarging or reducing 
the images, and the image obtained thereby is then subjected to 
5a second alignment entailing the division of the aligned image 
into a plurality of local - regions, and then matching each 
corresponding local - region, based upon which a non-linear 
distortion translation (warping) dependent on curve- fitting 
(two-dimensional, 10th order polynomial function) is performed. 

10 The utilization and combination of such techniques , etc. are known 
as shown in Japanese Unexamined Patent Publication No. 
7 (1995) -37074, etc. 

However, after aforementioned alignment has been performed, 
small misregistrations occur between the outlines of structural 

15 positions that have not been perfectly aligned 

(position-misregistration) , and artifacts appear in an 
interimage-dif f erence image where position-misregistrations 
occur at such outlines. Up until now, if no artifacts appeared 
in an interimage - difference image, because only the substantial 

20 difference between two images, representing the change due to 
the progress of the course of a disease, etc. of a diseased part, 
showed up, the size of a diseased part, the course of a disease, 
etc. could be effectively judged. If artifacts appeared in the 
image however, they obscured and thereby prevented the substantial 

25 difference from being discerned with accuracy, creating the 
possibility that the difference might be overlooked. 
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Particularly for cases in which the images are radiation 
images, because the three-dimensional (3-D) misalignments, 
occurring due to the slight changes in the direction from which 
the radiation is emitted, the axis of the body and its angle, 
5 the angle at which the radiation enters the subject, etc., 
represented in a two-dimensional (2-D) image are exceedingly 
difficult to correct by use of alignment techniques, the 
appearance of artifacts is to some extent unavoidable. 

However, it is necessary to eliminate the potential that 
10 the substantial difference be overlooked due to the appearance 
of artifacts. 

SUMMARY OF THE INVENTION 
The present invention has been developed in consideration 
of the in the prior art problems described above. 

15 Accordingly, the first objective of the present invention 

is to provide an image processing method and system that reduces, 
more than in the prior art, the occurrence of artifacts, relative 
to the substantial difference between two images, due to 
misalignment of structural positions within the images. 

20 The image processing method and system of the present 

invention improve examination -reading efficiency of the 
substantial difference between two images, which is the area of 
interest to a viewer of the images, by enhancement of said 
substantial difference relative to said artifacts, and thereby 

25 further reducing the occurrence of artifacts due to misalignment 
of structural positions, which adversely affect 



4 



inspection- reading of the difference between images. 

That is to say, the image processing method of the present 
invention, in which two desired images from among a plurality 
of images taken of the same subject are subjected to an 
5 interimage-dif f erence computation process to obtain an 

interimage-dif f erence image representing the difference between 
the two images, is characterized in that the substantial 
difference between the aforementioned two images represented in 
the interimage-dif f erence image is enhanced relative to the 
10 artifacts appearing in the interimage - difference image due to 
misalignment of corresponding structural positions of 
aforementioned two images. 

As aforementioned two images, the present invention is 
applicable to radiation images taken of the same subject at 
15 different points in time in a time sequence manner. Application 
of the present invention is particularly effective for images 
taken of a live body. Because the internal structures of a living 
body move in three dimensions, the relationship of corresponding 
structural positions between the two images easily become 
20 displaced between images, due to the ease with which 
position-misregistrations (misalignments) occur. 

Note that the referent of the expression "two desired images 
from among two or more images taken of the same subject" is not 
limited to images taken of the same part of the same subject at 
25 different points in time in a time series manner, but also can 
include each portion representing each portion of images taken 
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on the same day containing positions of substantially the same 
form (for example, left and right lungs, left and right breasts, 
etc) . That is to say, the referent of "two images", or "two or 
more images" is not limited to being two different images, but 
5 can refer also to different sections of the same image. 

Employment of a subtraction process between the 
corresponding structural positions of two images is advantageous 
in the present invention, because it is easy to improve the clarity 
of the difference between the two images obtained thereof by 

10 expressing the difference as an image signal. Note that, the 
present invention is not limited however, to being able to employ 
only a subtraction process as image processing; the application 
of processes such as a division process , etc. cannot be di scarded . 
The subtraction process can comprise simple subtraction, or a 

15 weighted subtraction . The image obtained by a subtraction process 
is generally called a subtraction image. Subtraction images 
include energy subtraction images, which are obtained by 
performing simple subtraction between two original energy images 
differing in energy distribution profiles (original images: a 

20 high energy image <a normal radiation image>, a low- energy image 
<a high-energy control image>) obtained at substantially the same 
in a time in a time sequence manner ; time -elapse subtraction images , 
which are obtained based on two original images taken at different 
points in time in a time series manner; DSAs (Digital Subtraction 

25 Angiographs) , which are obtained based on two original images 
of avein taken before and after a contrast medium has been injected 
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into a vein, etc. 

Relative- enhancement processing of the artifacts 
appearing in the substantial difference between two images 
represented in the interimage-dif f erence image can entail 
5 enhancement of the artifacts, or conversely, the control of such 
artifacts . 

Application of a processing method based on a morphology- 
process, which utilizes structural elements smaller than the 
substantial difference and larger than the artifacts, to control 

10 artifacts relative to the substantial difference is advantageous . 
This is because is such artifacts can be effectively controlled 
without adversely effecting the image clarity of the substantial 
differencebetween two images . Generally, morphology is developed 
as a set theory for an N- dimensional space, however, there are 

15 many examples of its application to two-dimensional images (refer 
to Japanese Unexamined Patent Publication Nos . 8 (1996) -272961, 
9 (1997) -248291, 9 ( 1997 ) - 9 142 1) . Hereinafter follows a simple 
explanation of the morphology process, using a contrast - image 
as an example. 

20 A one -dimensional function f (x) is tobe applied to a section 

of a contrast image regarded as a space having an adequate height 
at a point with the coordinates (x, y) having a contrast value 
f. As shown in formula (1), the morphology process utilizes 
structural element g in a syimmetrical function symmetrical to 

25 the original point. 
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[Formula 1] 

(X) =g (-X) 



The value for the defined area is 0, and the defined area 
g is as shown in equation (2) . 
[Formula 2] 

G ={-m,-m+1,-, -1,0,1, -,111-1, m} ( 2 ) 
At this juncture, the base shape of the 
morphology- computation is extraordinarily simple, as shown in 
formulae (3) - (6) 
[Formula 3] 



di lation 
erosion 
opening 
closing 



[feG^](i)=max{f(i-in),-,f(i),-,f(i+m)} ( 3 ) 

[f0G^](i)=[nin{f(i-m),-,f(i),-,f(i+m)} ( 4 ) 

f«=(feg^)©g (5) 

f^=(f©g^)0g (6) 



15 That is to say, the dilation process comprises finding the 

largest value within the range of the width i m ( the value determined 
in accordance to structural element B, corresponding to the mask 
size shown in Figs. 9A to 9D) , for the pixels of interest at 
the center thereof (refer to Fig. 9A) . On the other hand, the 

20 erosion process comprises finding the smallest value within the 
range of the width im for the pixels of interest at the center 
thereof (refer to 9B) . Additionally, the opening - process 
comprises performance of the erosion process followed by 
performance of the dilation process, in other words, the process 

25 of first finding the smallest value, and then finding the largest 
value; and the closing-process comprises performance of the 



dilation process followed by performance of the erosion process , 
in other words, the process of first finding the largest value, 
and then finding the smallest value. 

In other words, the opening -process corresponds to 
5 smoothing density curve f (x) from the low- density side so as 
to control the convex- shaped contrast- shift areas (portion having 
a higher density than that of the areas surrounding it) to a 
spatial range narrower than that of mask 2m (refer to Fig. 9C) . 
On the other hand, the closing -process corresponds to 
10 smoothing density curve f (x) from the high-density side so as 
to contain the concave - shaped contrast - shift areas (portion 
having a lower density than that of the areas surrounding it) 
to a spatial range narrower than that of mask 2m (refer to Fig. 
9D) . 

15 Here, compared to cases in which there is a signal having 

a high luminescence signal level, the relationship is reversed 
for cases in which there is a signal having a high density signal 
level in correlation to the increase in density level thereof: 
the dilation processing of a signal having a high density signal 

20 level is equivalent to the erosion processing of a signal having 
a high luminescence signal level (refer to Fig. 9B) ; the erosion 
processing of a signal having a high density signal level is 
equivalent to the dilation processing of a signal having a high 
luminescence signal level (refer to Fig. 9A) ; the 

25 opening-processing of a signal having a high density signal level 
is equivalent to the closing-processing of a signal having a high 
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luminescence signal level (refer to Fig. 9D) ; and the 
closing-processing of a signal having a high density signal level 
is equivalent to the opening-processing of a signal having a high 
luminescence signal level (refer to Fig. 9B) . 
5 Therefore, by subjecting an image signal representing an 

original image to opening or closing morphology ( "Morphology", 
authored by Kobatake, published by Corona, etc.), granularity 
(meaning the noise in an image) can be controlled (or eliminated) . 
Note that although for the sake of simplicity an explanation has 

10 been prof fered using a one-dimensional mask ( structural element) 
for a one -dimensional density distribution as an example, for 
cases in which an image expands two - dimensionally , multiple 
one - dimensional structural elements can be set therein, and 
multiple iterations of the processing can be performed, once for 

15 each structural element, or a two dimensional - structural element 
can be set and processing can be concluded after one iteration 
of the processing on the two-dimensional structural element. 

The apparatus according to the present invention for 
performing the image processing method of the present invention 

20 is provided with an image processing means for processing an 
interimage - difference image obtained by subjecting two desired 
images from among two or more images obtained of the same subject 
to interimage -processing; wherein, aforementioned image 
processing means subjects aforementioned interimage-dif f erence 

25 image to processing so as to emphasize the substantial difference 
between the two images relative to the artifacts occurring due 
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to misalignment of structural elements with the two images. 

Note that as described above, aforementioned "two desired 
images from among two or more images taken of the same subject" 
can refer, for example, to two radiation images taken of the same 
5 part of the same subject at different points in time in a time 
series manner, but is not limited to this. 

Application of the present invention to two or more X-ray 
images of the same subject take at different points in time for 
the purpose of comparison is effective and advantageous. 

10 It is preferable that subtraction processing be applied 

between corresponding structural positions of two images as the 
interimage processing. 

As an image processing means, it can be used to carry out 
image processing so as to control the artifacts relative to the 

15 substantial difference between two images, or conversely, to 
emphasize the substantial difference between to images relative 
to the artifacts occurring thereof. For cases in which the image 
processing means performs processing to control the artifacts, 
it is desirable that such processing be performed based on the 

20 application of morphology employing structural elements that are 
larger than the artifacts and smaller than the substantial 
difference . 

Note that there is nothing in the image processing method 

and apparatus described above that interferes application thereof 
25 to subject matter other than the human body, such as plants and 
animals, industrial products, geological formations, heavenly 
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bodies, landscapes, etc. 

According to the image processing method and apparatus of 
the present invention, by subjecting an interimage -difference 
image to processing so as to enhance the substantial difference 
5 between to images relative to the artifacts, which adversely 
effect image examinabili ty , the artifacts can be reduced relative 
to the substantial difference between the images, which is the 
portion of interest between the images , and the difference between 
the images is thereby rendered more easy to examine than in the 
10 prior art, and image examining efficiency is improved. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 shows the configuration medical network 
implementing an embodiment of the image processing apparatus of 
the present invention, 
15 Figure 2A and 2B show two original images that are to be 

subjected to temporal subtraction processing by the interimage 
processing apparatus. 

Figure 3 is a figure provided for explanation of global 
matching, 

20 Figure 4 is a figure provided for explanation of local 

matching. 

Figure 5 is a figure provided for explanation of non- linear 
warping transformation. 

Figure 6A, 6B and 6C show a case in which the first image, 
25 and the second image, have been completely matched, and a 
subtraction image, 
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Figure 7 shows an example of an substantial subtraction 

image. 

Figure 8A to 8D are figures provided for explanation of 
the temporal imageprocessingperf ormedin the current embodiment, 
and 

Figure 9A to 9D are figures provided for explanation of 
morphology. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, a preferred embodiment of the image processing 
method and apparatus according to the present invention will be 
explained with reference to the drawings. 

Figure 1 shows a medical network 100 implementing an 
embodiment of the image processing method and apparatus 10 
according to the present invention. 

Connected to network 100 shown in the drawing are: a CR 
(Computed Radiography) 5 0 or other such medical image formation 
apparatus such as a CT (Computed Tomography) apparatus, MRI 
(Magnetic Resonance) apparatus, etc. ; a cumulative data base 70 
for storing each type of diagnostic image created by 
aforementioned medical image formation apparatuses; a display 
apparatus 20 for displaying images stored in database 70 and images 
transmitted directly from the image formation apparatuses; an 
interimage processing apparatus 3 0 that obtains a temporal 
subtraction image (one type of interimageprocessing image) , based 
on two or more image data input thereto, by performing a temporal 
subtraction process, which is one example of interimage 
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processing; and an image processing apparatus 10 for subjecting 
the subtraction image formed by interimage processing apparatus 
30 to the image processing described below. Note that also 
connected to network 100 are various types of image output devices 
such as printers, etc. for outputting images circulated within 
the network to film, etc. that are not shown in the drawings. 

An image of a subject through which radiation is obtained 
by CR apparatus 50, which is provided with a sheet that has a 
stimulable phosphor layer that absorbs some of the radiation 
energy passed through the subject and records an image thereof 
thereon. Afterwards, by photoelectrically reading the radiation 
energy stored on the stimulable phosphor sheet, which is emitted 
as a stimulated emission when said stimulable phosphor sheet is 
irradiated with a laser beam, the CR apparatus 50 obtains the 
radiation image of the subject as digital image data; such systems 
are in wide use in medical facilities. 

QA-WS workstation 60 (for checking image quality) . which 
is connected along the network between CR apparatus 5 0 and network 
10 0, checks images formed by aforementioned CR apparatus 5 0 and 
other medical image formation apparatuses, and is provided with 
a function for issuing a request to the medical image forming 
apparatus (CR apparatus 50, etc>) , to re-take an image, etc. In 
this embodiment, before storing digital image P created by CR 
apparatus 5 0 into database 70 , QA-WS 6 0 is provided so as to perform 
an image quality check of the image density, contrast, etc. and 
also a check of the photographed range of the image, etc. 
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Display apparatus 20 is not merely for displaying as a visual 
image the images input thereto from database 70, itisalso equipped 
with functions to provide for use thereof as a terminal for 
inputting requests to perform subtraction processing, etc. 
5 between two or more images P taken of the same part of the same 
subj ect . 

As described above, interimage processing apparatus 30 
obtains a temporal subtraction image, based on two or more chest 
radiation images PI and P2 taken of the same subject at different 

10 points in time in a time series manner and input from database 
70 via network 100, that represents the substantial difference 
between the two images, and also aligns the structural positions 
appearing within images PI and P2 (ribs, the chest, lungs, the 
heart and other organs, etc.): first, a global matching is 

15 performed; after that, a second matching process in which the 
images are divided up into a plurality of local regions, each 
of which is then registered with its respective counterpart; and 
based on the two images obtained thereby, corresponding pixels 
between the two images are subtracted. Note that each matching 

20 process will be explained in detail below. 

The image processing performed by image processing 
apparatus 10 on the temporal subtraction image Psu obtained by 
interimage image processing apparatus 3 0 comprises the 
enhancement of the substantial difference between images PI and 

25 P2 represented by subtraction image Psu, which has been obtained 
by application of image position matching processes, relative 
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to artifacts L appearing therein due to misalignment between 
structural positions within images PI and P2 . That is to say, 
relative control of artifacts L is not performed wherever they 
are caused by position gaps between structural positions within 
5 images PI and P2 , but with respect to the tumor or diseased portion 
(hereinafter referred to simply as the diseased port ion) appearing 
in only one of either image PI or P2, or to the diseased portion 
K contained in both images PI and P2 , etc., which have different 
densities or outlines in images PI and P2, being examined to 
10 determine the effect of treatment and the change over time in 
the course of the disease. 

More specifically, with respect the frequent cases in which 
artifacts L, characterized in that they are long and thin forms, 
appear along the outlines of structural bodies, although there 
15 is change in the diseased portion K that is the substantial 
difference between images according to the course of the disease 
after the initial appearance thereof, the form thereof expands 
in a substantially circular or substantially rectangular form 
of a wider region than the long and narrow form of artifacts L, 
20 and can be recognized. Accordingly, by application to such a 
subtraction image Psu of morphology processing utilizing 
structural elements larger than the width (at a substantially 
perpendicular cross - section with respect to the lengthwise 
direction thereof) of the long and thin artifacts L and smaller 
25 thandiseasedportionK (for example, circular structural elements 
having such a diameter, rectangular structural elements having 
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a side of such a length, etc . ) as said image processing, diseased 
part K, which is larger in size than the structural elements, 
remains and long and thin artifacts L, which are smaller in size 
than the structural elements, can be eliminated. 

Note that for cases in which morphology processing is 
applied to subtraction image Psu, which is a high and low density- 
image, Psu is divided into a high-density image (the whole image 
obtained by replacing the portion having a density lower than 
the base density with the base density) Psul composed of the base 
density (the portion in which the difference in density between 
PI and P2 is 0) of Psu and the densities higher than the basic 
density, and a low density image (the whole image obtained by 
replacing the portion having a density higher than the base density 
with the base density) Psu2 composed of the base density and the 
densities lower than the base density. High- density image Psul 
and low- density image Psu2 are then subjected to aforementioned 
morphology processing, and because it is preferable that the two 
images obtained thereby be subjected to an addition processing 
(at a weighted ratioof 0.5X0.5), the processing will be explained 
as such. 

Next, the operation of the image processing apparatus will 
be explained. 

Chest radiation transparency images PI, P2, .... Pn are taken 
of a specific patient at different points in time in advance by 
CR apparatus 50, and after an image quality control check is 
conducted by QA-WS60 on PI, P2,..., Pn, they are stored in database 
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First, an explanation of an example case in which, a request 
that a subtraction image Psu be obtained based on the image taken 
at the most remote point in time (the first image,) , PI, and an 
image taken at a point in time less remote (the second image,) , 
P2 has been specified from display terminal 20, which serves as 
the specification input terminal. 

The request input at display terminal 2 0 is input to database 
70 via network 100, and the first image, PI and the second image, 
P2 are input via network 100 to interimage processing apparatus 
30. 

Interimage processing apparatus 30 first subjects images 
PI and P2 to global matching, in which the structural positions 
between said two images are matched, and then divides each image 
obtained thereby into a plurality of local regions and matches 
the positions of each local region to its respective counterpart. 
That is to say, of the two images shown in Fig. 2 taken in a time 
series manner, the newer image (the second image,) thereof is 
taken as the base image, and the first image, PI, is subjected 
to af f ine transformation and globally matched to the second image, , 
P2 (refer toFig. 3) . Continuing, the second image , , P2, of globally 
matched images PI and P2 is subjected to processing wherein it 
is divided into a plurality of hypothetical small rectangular 
template regions T2 by use of a template, the the first image, , 
PI is registered to each template T2 region of the second image, 
P2 . A search region Rl, which is larger than template region T2 , 
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is set for each template region T2, and in each search region 
Rl, the corresponding template region substantially matched to 
each template region T2 of the second image, P2, is obtained (refer 
to Fig. 4) . Based on the shift amount between positions of each 
5 template region T2 of the second image, P2 , and each corresponding 
template region of the first image, PI, global matching is 
performed so that each corresponding region of the first image, , 
PI is substantially matched to each template region T2 of the 
second image, , P2 , and then the first image, , PI, in its entirety 

10 s subjected to non- linear warping (refer to Fig. 5} and images 
PI and P2 are again matched. 

Further, interimage processing apparatus 30 coordinates 
the pixels of the first image, , PI, which has been subjected to 
the two position matching transformation steps described above, 

15 and the second image, , P2 , which has served as the base image, 
and subjects the first image,, PI, and the second image,, P2, 
to subtraction processing in accordance with formula 7 described 
below, whereby subtraction image Psu of images PI and P2 is 
obtained . 

20 (Formula 7) 

Psu = (PI - P2) X cont + mid 

Cont : contrast coefficient 

mid : mean value (for cases in which processing is 

10 bit, 512) 

25 Normally, because the portions of images PI and P2 in which 

there is no difference in density are displayed as the mean value. 
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subtraction image Ssu is formed based on formula 7. In addition, 
because diseased part K contained in the second image, P2 is 
displayed as a high- density (dark) portion, P2 is subtracted from 
PI. That is to say, due to the frequency of occurrence of cases 
5 in which diseased part K appears as a low- density shadow in the 
second image, P2 , although diseased part K is appears as a low 
density portion in subtraction image P su' obtainedby subtracting 
PI from P2, because diseased part K is normally displayed as a 
high-density portion on the display apparatus , subtraction image 
10 Psu is usually converted and then output. Because said conversion 
processing in the display apparatus is omitted in the current 
embodiment, subtraction is carried out based on aforementioned 
formula 7 . 

Note that there are cases for which the order in which images 
15 PI and P2 are subtracted is reversed. For example, depending on 
the type of disease and the nature of the change thereof, there 
are instances in which diseased part K appears as a high-density 
shadow in the second image, P2 . Further, even for cases in which 
the diseased portion appears as a high-density shadow, because 
20 of a reversal in the diseased part due to treatment thereof, there 
are cases in which the absence of the diseased part is observed. 
Therefore, the order in which subtraction between images PI and 
P2 is performed can be set according to the type of disease and 
the objective of the examination. 
25 Here, when the positionmatching described above is complete, 

as shown in Fig. 6, subtraction image Psu, which is the difference 
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between the first image, PI, and the second image, , P2, represents 
the diseased portion K that is the substantial difference between 
images PI and P2 that is actually only present in the second image, , 
P2 , and isnotpresent in the first image, , PI . However, inactuality, 
5 complete matching is very difficult to obtain, and not only 
diseased portion K, but artifacts L (refer to Fig. 7) caused by 
misalignment of the outlines of ribs and other structural bodies 
within the images also remain in subtraction image Psu, and 
examination reading performance suffers thereby. 

10 Here, in the current embodiment , image processing apparatus 

10 controls artifacts L remaining in subtraction image Psu 
relative to diseased portion K. More specifically, subtraction 
image Psu (Fig. 8A) is divided into a high-density image (the 
whole image obtained by replacing the portion having a density 

15 lower than the base density with the base density) Psul composed 
of the base density (the portion in which the difference in density 
between PI and P2 is 0) of Psu and the densities higher than the 
basic density, and a low density image (the whole image obtained 
by replacing the portion having a density higher than the base 

20 density with the base density) Psu2 composed of the base density 
and the densities lower than thebase density (Fig. 8B) . Continuing, 
on the one hand, high- density image Psul is subj ected to morphology 
processing (opening processing) utilizing structural components 
(round) whose size has been set in advance (Fig. 8C) , and on the 

25 other hand, low-density image Psu2 is subjected to morphology 
processing (closing processing) utilizing structural components 
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(round) whose size has been set in advance (same Fig.) . Here, 
as described above, the structural elements utilized are of a 
size larger than the long and thin artifacts L and smaller than 
diseased portion K, and are set in advance based on the accumulated 
clinical data. For a case in which the size of subtraction image 
Psu is 1760 X 1760 pixels (5 lines/mm) , it is preferable that the 
round structural elements, for example, be of a diameter of 5-10 
pixels. Of course, the structural elements can be changed in 
accordance with the size and shape of the diseased portion in 
the extracted image or the size and shape of the artifacts to 
be eliminated therefrom. 

In the opening process morphology, because high density- 
portions within the size range smaller than the structural 
elements are eliminated, almost all artifacts LI (artifacts L 
that appear in the high-density range are designated as artifacts 
LI) larger than diseased portion K are eliminated. Likewise, in 
the closing process morphology, because low-density portions 
within the size range smaller than the structural elements are 
eliminated, almost all artifacts L2 (artifacts L that appear in 
the low-density range are designated as artifacts L2) larger than 
diseased portion K are eliminated (Fig. 8C) . 

The pixels of subtraction images Psul and Psu2 obtained 
in this way are again registered and the addition processing 
performed at a weighted ratio of 0.50 X 0.50 for both images, 
and subtraction image Psu is again recomposed. 

Because subtraction image Psu recomposed and obtained in 



this way is an image in which artifacts L caused by misalignment 
of structural positions in images PI and P2 have been controlled 
relative to diseased portion K of both images PI and P2 (eliminated) , 
obstruction of examination of diseased portion K due to artifacts 
5 has been reduced, with respect to the prior art. 

Subtraction image Psu, which provides for excellent 
examination performance, is input to image display apparatus 20, 
and displayed as a visible image thereon. Because the artifacts 
contained in the visible image of subtraction image Psu displayed 
10 on image display apparatus 2 0 have been controlled, there are 
no obstructions to the examination of diseased portion K, and 
examination efficiency thereof is improved, with respect to the 
prior art. 

According to the image processing apparatus of the current 
15 embodiment described above, by performing image processing, on 
an interimage-processed image, that enhances the substantial 
difference of the two images relative to the artifacts , artifacts , 
which can have an adverse effect on the image examination, can 
be reduced relative to the substantial difference between two 
20 images, which is the portion of interest to an examiner of the 
image, and examination of the substantial difference between two 
images can be performed more efficiently and effectively relative 
to the prior art. 

In the current embodiment, an opening process morphology 
25 processing was performed on high- density subtraction image Psul , 
however, the same results obtained by application of the opening 
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process morphology can be obtained by application of a minim-urn 
filter in place thereof. Likewise, a closing process morphology 
processing was performed on low-density subtraction image Psu2, 
however, the same results obtained by application of the closing 
5 process morphology can be obtained by application of a maximum 
filter in place thereof. 

In addition, because there are narrow ranges in which the 
density in a high and low contrast image changes drastically, 
artifacts having such sheer are searched by a Laplacian filter, 

10 and by subj ecting to a smoothing processing the artifact obtained 
by the search therefor, the artifacts can be controlled relative 
to the substantial difference of the diseased portion, etc. 
Likewise, because artifacts contain many more frequency 
components in the high frequency range than does the substantial 

15 difference of the diseased portion, etc., the detected high 
frequency components can be made to be un- sharp. Making the high 
frequency components un- sharp can comprise performance of a 
Fourier transformation and excluding the high frequency range, 
and then performing a reverse Fourier transformation, or an 

20 processing utilizing an un- sharpness mask can be employed to 
smooth out the edges. Note that for the radiation image that was 
the subjectof the image processing appliedby the image processing 
apparatus of the embodiment described above, the artifacts 
occurred mainly due to the ribs, which extended in the horizontal 

25 direction, and a even if un- sharpness processing is performed 
only in the vertical direction, the effect of the present invention 
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can be adequately obtained. 

In addition, instead of processing that controls the 
artifacts, processing that emphasizes the substantial difference 
of the diseased portion, etc. can be performed. For example, the 
5 low frequency components that represent the tumor, etc. that is 
the diseased portion can be emphasized. Of course, it is also 
possible to perform processing to control the artifacts as well 
as processing to emphasize the substantial difference of the 
diseased portion, etc. 
10 Note that in the embodiment described above , by performance 

by interimage processing apparatus 30 of the non- linear 
transformation (warping) to match the positions of the local 
regions, the first image, , PI, as shown inFig. 5, does notmaintain 
its original image shape (rectangular) . Accordingly, the first 
15 image, PI, after being subjected to warping does not does not 
have the exact rectangular outline as shown in Fig. 6A, but has 
a curved, non- linear outline . On the other hand, because the second 
image, P2 has been subjected to no transformation processing 
whatsoever, it has a straight - line outline . Therefore, whenpixels 
20 of the two images are to be registered and subtraction processing 
performed, there are cases for which there is no corresponding 
pixel in the first image, , PI that has been subjected to warping 
for a pixel in the second image, P2, and subtraction processing 
cannot be performed for the missing pixel. 
25 In such a case, when there is no corresponding pixel in 

the image subjected to transformation processing (image PI in 
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the embodiment described above) for a pixel in the image not 
subjected to transformation processing, which serves as the base 
image, a new pixel can be set for the missing pixel, and the pixel 
value of that pixel can be given the same value as the corresponding 
5 pixel in the corresponding image (the second image,). 

In addition, aside from supplementing the pixels in this 
way, the pixel in the base image can be deleted, the same as the 
pixel in the image that has been subjected to transformation 
processing. Because there are extremely few instances in which 

10 theportionof the image having no corresponding pixel fallswithin 
the region of the containing the area of interest to an examiner 
of the image, it has conventionally thought to be unnecessary. 
Carrying this idea one step further, by performance of an 
extraction processing that extracts only the image portions of 

15 the regions of interest contained within each of the images , which 
are the image subjected to warping (the first image,) and the 
base image (the second image,) , the portion of the images to be 
subjected to subtraction processing can be limited in advance. 
This is also desirable in that the amount of computation is reduced . 

20 In the embodiment described above , because a chest radiation image 
has been the subject of processing, and in both the image that 
has been subjected to warping (the first image,) and the base 
image (the second image, ) the area of interest is the chest, it 
is preferable that said two images be subjected to chest 

25 recognition processing, in which all the pixels of portions of 
the image other than that representing the chest are assigned 
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a fixed pixel value. Note that the techniques and technology 
disclosed in Japanese Unexamined Patent Publication No. 
8 (1996) - 335271 may be applied as such chest recognition 
processing . 
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